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DETAILED ACTION 
Continued Examination Under 37 CFR 1.114 

1. A request for continued examination under 37 CFR 1. 1 14, including the fee set forth in 37 CFR 1. 17(e), 
was filed in this application after final rejection. Since this application is eligible for continued examination under 
37 CFR 1.114, and the fee set forth in 37 CFR 1. 17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.114. Applicant's submission filed on 30 November 2004 has been 
entered. 

Response to Arguments 

2. The applicant's arguments, filed on 24 September 2004 , have been fully considered. A response to these 
arguments is provided below. 

Claim Rejections - 35 USC § 112(2) 

Summary of Argument : Applicant has amended claims 6, 13, and 19 in order to clearly define the metes and 
bounds of these claims and overcome the 1 12(2) rejections set forth in the final rejection (mailed 07-02-2004). 
Applicant argues that the claim amendment overcomes the prior rejection (see remarks pgs. 9-10). 

Examiner 's Response : The examiner agrees. The previous 112(2) claim rejections are hereby withdrawn. 

Claim Rejections - 35 USC § 103 

Summary of Argument : In the prior office action, claim 1 was rejected over Fang (USPN 5,771,3 18) in 
view of Asimopoulos (USPN 6, 195,467). Applicant traverses this rejection, and argues that the Asimopoulos 
reference fails to meet the claimed limitation of using characteristic differences among a plurality of pixels located 
on lines passing near the target pixel. Specifically, applicant argues that the arrows shown in Fig. 6 of Asimopoulos 
"merely refer to a pair of pixels (i.e. two pixels)." 

Examiner 's Response : Applicant's argument has been fully considered but is not persuasive. The 
examiner respectfully submits that two pixels are indeed a "plurality of pixels" as is stated in the claim. A 
"plurality" of pixels, by definition, is simply any number of pixels greater than one. Thus, the two pixels shown in 
Asimopoulos qualify as the claimed "plurality of pixels." 

Summary of Argument : Applicant further traverses the rejection to claims 13 and 19 over Fang in view of 
Okisu (USPN 6,091,862). Applicant argues that Okisu does not disclose the direction-dependent low pass filtering 
step recited in the respective claims. 
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Examiner 's Response : Applicant's argument has been fully considered but is not persuasive. Applicant 
alleges that that direction dependent low pass filtering step as recited in claims 13 and 19 is not disclosed in the 
Okisu reference. The examiner agrees. However, this point is irrelevant, as the Okisu reference was not used to 
meet that limitation of the claim. The direction dependent low-pass filtering step was met by the Fang reference, 
and is discussed in detail in the claim 1 rejection. The Okisu reference was merely brought in to meet the color 
limitations of the claim. The examiner submits that those limitations are met by Okisu. 

Claim Rejections - 35 USC §103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set 

forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claim 1 is rejected under 35 U.S.C. 103(a) as being unpatentable over Fang et al. (USPN 5,771,318) in 
view of Asimopoulos et al. (USPN 6,195,467). 

With regard to claim 1, Fang discloses a similarity judging step in which similarity among pixels are 
judged along four directions in a local area containing a target pixel undergoing low-pass filtering (column 3 line 63 
- column 4 line 25). The calculation of the local directional variances as disclosed in Fang is analogous to the 
similarity judgment recited in the claims in that it judges similarity among pixels along at least four directions in a 
local area containing a target pixel y(i,j) undergoing low-pass filtering. 

Fang further discloses a direction-dependent low-pass filtering step of performing a weighted averaging 
operation in which weighted pixel values of pixels around a target pixel are added to a pixel value of said target 
pixel and a result of said addition is divided by the sum of the weights (column 4 lines 35-50). Fang further 
discloses a weighting rate, along a direction manifesting marked similarity, becoming increased based upon the 
similarity judgment (column 4 lines 43-55). 

Fang further discloses that similarity is judged by using characteristic differences (i.e. directional variances) 
among a plurality of pixels located on lines passing through the target pixel along specific directions (column 4 lines 
33-37 in conjunction with Figure 1), but fails to expressly disclose that similarity is also judged using characteristic 
differences of pixels located on lines passing near the target pixel along specific directions. 

Asimopoulos, however, discloses using characteristic differences among a plurality of pixels located on 
lines passing through said target pixel along specific directions and characteristic differences among a plurality of 
pixels located on lines passing near the target pixel along specific directions (Asimopoulos Figure 6 in conjunction 
with col. 13 line 50 - col. 14 line 63). It would have been obvious to one reasonably skilled in the art at the time of 
the invention to modify Fang's low-pass filtering method by having the similarity judging step utilize characteristic 
differences between pixels passing through the target pixel and near the target pixel as taught by Asimopoulos. 
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Such a modification would have allowed for a more robust detection of image edges (Asimopoulos col. 14 lines 2-5) 
which would have allowed for a more accurate enhancemmt of the target pixel (Asimopoulos col. 13 lines 65-66). 

5. Claims 13, 15-16, 19 and 21 are rejected under 35 U.S.C. 103(a) as being unpatentable over Fang in view 
ofOkisu (USPN 6,091,862). 

With regard to claim 13, Fang discloses a method for low-pass filtering image data which comprises a 
similarity judging step and a direction-dependent low-pass filtering step (see the above argument with respect to 
claim 1). Fang fails to expressly disclose that the image data has values regarding a first color and values regarding 
a second color or a color difference between said second color and said first color. It follows that Fang also fails to 
expressly disclose that weighting rates are obtained based upon said first color and/or luminance values in which a 
weighting to said first color is high and weighted averaging is performed for said second color or said color 
difference using said weighting rates in said direction-dependent low-pass filtering step. 

Okisu, however, discloses that the image data has values regarding a first color and a second color (Okisu 
col. 4 lines 18-22). Okisu further discloses obtaining weighting rates based upon a first color in which the weighting 
to the first color is high (Okisu col. 5 line 63 - col. 6 line 7). The weighting rates (i.e. the e weight of the pixel 
values') disclosed in Okisu are based upon a first color (green). Okisu discloses that the weighting to the first color 
relative to a second color is high (Okisu col. 1 lines 59-61). The higher sampling frequency disclosed in Okisu is 
analogous to the claimed £ high weighting to the first color' relative to the second color. Okisu further discloses that 
weighted averaging is performed for the second color using said weighting rates (Okisu col. 4 lines 25-31). It would 
have been obvious to one reasonably skilled in the art at the time of the invention to modify Fang's image 
processing method by adding the capability to process color image data as taught by Okisu. Such a modification 
would have allowed for a more robust system that could process color images as well as gray-scale images. 

With regard to claim 19, a computer-readable recording medium that stores a program which causes the 
computer to execute the steps of a method is essential if the image processing method disclosed in the combination 
of Fang and Okisu is to function. Therefore, a computer-readable recording medium is inherent in these teachings. 

With regard to claim 15, Okisu further discloses that the image data are generated by performing color 
separation in which reflected light from an object is captured with color filters arranged in a Bayer array (Okisu col. 
1 lines 17-23). The limitations recited in the second paragraph of claim 15 have already been addressed with regard 
to claim 13. 

With regard to claim 16, Okisu discloses implementing processing on G color image data, R color image 
data and B color image data (Okisu col. 4 lines 26-3 1). Okisu also discloses implementing processing on color 
difference data (Okisu col. 4 lines 37-63). 

With regard to claim 21, Fang discloses a direction-dependent low-pass filtering step with four weighting 
rates corresponding to four different filter directions. It can be seen in Figure 1 that one of weighting rates is applied 
for the pixels to the left and right of the target pixel, one of the weighting rates is applied for the pixels above and 
below the target pixel, one of the weighting rates is applied for the pixel above the target pixel on the right and 
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below the target pixel on the left, and one of the weighting rates is applied for the pixel above the target pixel on the 
left and below the target pixel on the right Although Fang does not explicitly state that the target pixel itself has a 
weighting rate associated with, we can see from Figure 1 that the target pixel is used in the determination of all of 
the four other weighting rates. As a result, a first weighting rate for the target pixel is inherent in Fang's direction- 
dependent low-pass filtering step. 

6. Claims 4-7 are rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of Fang and 
Asimopoulos as applied to claim 1 above, and further in view of Shiraishi (USPN 5,253,046). The arguments as to 
the relevance of Fang and Asimopoulos as applied above are incorporated herein. 

With regard to claim 4, the combination of Fang and Asimopouslos discloses a similarity judging step, but 
fails to expressly dislclose that the image data being judged is a color image with at least two types of color 
information. Shiraishi, however, discloses performing processing on at least two types of color information 
(Shiraishi column 10 lines 59-61 in conjunction with element 1 12 of Figure 6). It would have been obvious to one 
reasonably skilled in the art at the time of the invention to modify Fang and Asimopoulos's similarity judging step 
by adding color image processing capability as taught by Shiraishi. Such a modification would have made for a 
more robust system that could do similarity judging and subsequent low-pass filtering on additional types of images. 

With regard to claim 5, Shiraishi further discloses that processing is performed on a color image that has 
yet to undergo interpolation processing (Shiraishi column 23 lines 45-49 in conjunction with Figure 28). 

With regard to claim 6, the combination of Fang and Shiraishi discloses calculating similarity values along 
specific directions using characteristics differences of color image data. Calculating characteristics differences 
among a plurality of same color pixels and/or a plurality of different color pixels is inherent in the calculation of the 
characteristics differences of a color image along specific directions. Therefore, this is inherently taught in the 
combination of Fang, Asimopoulos and Shiraishi. 

With regard to claim 7, Shiraishi further discloses that the image processing is performed on color image 
data having undergone white balance processing (Shiraishi column 10 lines 55-61 in conjunction with element 1 1 1 
of Figure 28). 

7. Claim 8 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of Fang, 
Asimopoulos and Shiraishi as applied to claim 6 above, and further in view of Ikeda. The arguments as to the 
relevance of the combination of Fang and Shiraishi as applied in paragraph 6 above are incorporated herein. 

The aforesaid combination discloses all of the limitations of claim 8 except that it fails to expressly disclose 
the step of detecting a degree of saturation of a target pixel in the calculation of characteristics differences of a 
plurality of color pixels. Ikeda, however, discloses determining a saturated region of a color image in a low-pass 
filter environment (Ikeda column 3 lines 20-25). It would have been obvious to one reasonably skilled in the art at 
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the time of the invention to modify the image processing method for low-pass filtering a color image as disclosed in 
the combination of Fang and Shiraishi by detecting a degree of saturation of the color pixels as taught by Ikeda. 
Such a modification would have allowed for a system in which characteristics differences of color pixels were 
detected with regard to saturation components of the color pixels in addition to the color components. 

8. Claims 9-11 are rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of Fang and 
Asimopoulos as applied in claim 1 above, and further in view of Ikeda. The arguments as to the relevance of the 
aforesaid combination as applied above are incorporated herein. 

With regard to claim 9, the combination of Fang and Asimopoulos discloses a direction dependent low-pass 
filtering processing which is implemented on target pixels of an image data, but fails to expressly disclose that said 
image data undergoes interpolation processing to interpolate pixels with missing color components. Ikeda, however, 
discloses a low-pass filter environment in which color interpolation processing is performed (Ikeda column 6 lines 
15-22 in conjunction with Figure 5). It would have been obvious to one reasonably skilled in the art at the time of 
the invention to combine the color image data interpolation processing as taught by Ikeda with Fang and 
Asimopoulos 's method of performing directional dependent low-pass filtering on an image. Such a modification 
would have allowed for a more robust system that could perform the low-pass filtering operation on color image 
data that had previously been interpolated. 

With regard to claim 10, Ikeda further discloses limiting pixel values of color pixels by a threshold 
corresponding to a largest pixel value or a smallest pixie value in a specific area near the corresponding pixel (Ikeda 
column 9 line 59 - column 10 line 14). It would have been obvious to one reasonably skilled in the art at the time of 
the invention to combine the limiting of pixel values by using maximum and minimum threshold values as taught by 
Ikeda with Fang and Asimopoulos 's method of performing low-pass filtering on an image. Such a modification 
would have allowed for interpolation results which did not fall outside the upper and lower boundaries of the pixels 
in an area. 

With regard to claim 1 1, Ikeda discloses performing interpolation processing on color image data that has 
yet to undergo low-pass filtering processing (Ikeda column 6 lines 15-19 in conjunction with Figure 5). It is well 
known in the art that a color image data in which one color (a first color) has a higher pixel density than another 
color (a second color) will inherently contain vacancies of color information. The steps of calculating a color 
difference between the first and second color, obtaining an interpolation value based on the difference, and then 
restoring the second color based on the interpolation are all inherent in the process of performing interpolation 
processing on color image data. Consequently, the limitations of the claim are inherent in the combination of Fang, 
Asimopoulos and Ikeda. 
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9. Claim 12 is rejected under 35 U.S.C. 103(a) as being unpatentable over the combination of Fang, 
Asimopoulos and Ikeda as applied to claim 1 1 above, and further in view of Shiraishi. The arguments as to the 
relevance of the aforesaid combination as applied above are incorporated herein. 

With regard to claim 12, Shiraishi further discloses that processing is performed on a color image that has 
yet to undergo interpolation processing (Shiraishi column 23 lines 45-49 in conjunction with Figure 28). It would 
have been obvious to one reasonably skilled in the art at the time of the invention to modify the direction dependent 
method of low-pass filtering a color image disclosed in the combination of Fang, Asimopoulos and Ikeda by 
including the further limitation of interpolating a color image that has already undergone image processing as taught 
by Shiraishi. Such a modification would have made for a more robust system that could interpolate the color image 
either before or after low-pass filtering of the image has been performed. 

10. Claim 22 is rejected under 35 U.S.C. 103(a) as being unpatentable over Fang and Okisu as applied to claim 
2 1 above and further in view of well known prior art. Fang discloses the first weighting rate for the target pixel is 
(l/2m + 1) (Fang column 4 equations 10. 1 - 10.4). The summation tarns of those four equations, which are 
multiplied by (l/2m + 1) as disclosed in Fang are analogous to tt, yy, nu, and ns as recited in the claim. The claimed 
value, k, which represents a predetermined value, is simply 1 in the equations of Fang. Although Fang does not 
expressly disclose that the terms analogous to claimed tarns tt, yy, nu and ns add together to equal 1, this further 
limitation merely calls for the normalization of the four terms. Normalization is well known in the art (Official 
Notice), and it would have been obvious to a person of ordinary skill in the art at the time of the invention to include 
the normalization of the four terms. Such a modification would have resulted in more efficient computations. 



Allowable Subject Matter 

1 1 . Claims 2 and 3 are allowed. 



Conclusion 

12. Any inquiry concerning this communication or earlier communications from the examiner should be 
directed to Patrick L Edwards whose telephone number is (703) 305-6301. The examiner can normally be reached 
on 8:30am - 5:00pm M-F. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Bhavesh Mehta 
can be reached at (703) 308-5246. The fax phone number for the organization where this application or proceeding 
is assigned is 703-872-9306. 
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information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the 
Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 




